On Existence of Limiting Distribution for Time-Nonhomogeneous Countable Markov Process
نویسندگان
چکیده
In this paper, sufficient conditions are given for the existence of limiting distribution of a nonhomogeneous countable Markov chain with time-dependent transition intensity matrix. The method of proof exploits the fact that if the distribution of random process Q = (Qt )t 0 is absolutely continuous with respect to the distribution of ergodic random process Q◦ = (Q◦t )t 0, then Qt law −→ t→∞ where π is the invariant measure of Q◦. We apply this result for asymptotic analysis, as t → ∞, of a nonhomogeneous countable Markov chain which shares limiting distribution with an ergodic birth-anddeath process.
منابع مشابه
On $L_1$-weak ergodicity of nonhomogeneous continuous-time Markov processes
In the present paper we investigate the $L_1$-weak ergodicity of nonhomogeneous continuous-time Markov processes with general state spaces. We provide a necessary and sufficient condition for such processes to satisfy the $L_1$-weak ergodicity. Moreover, we apply the obtained results to establish $L_1$-weak ergodicity of quadratic stochastic processes.
متن کاملExistence and Regularity of a Nonhomogeneous Transition Matrix under Measurability Conditions
This paper is about the existence and regularity of the transition probability matrix of a nonhomogeneous continuous-time Markov process with a countable state space. A standard approach to prove the existence of such a transition matrix is to begin with a continuous (in t) and conservative matrix Q(t) = [qij(t)] of nonhomogeneous transition rates qij(t), and use it to construct the transition ...
متن کاملThe Rate of Rényi Entropy for Irreducible Markov Chains
In this paper, we obtain the Rényi entropy rate for irreducible-aperiodic Markov chains with countable state space, using the theory of countable nonnegative matrices. We also obtain the bound for the rate of Rényi entropy of an irreducible Markov chain. Finally, we show that the bound for the Rényi entropy rate is the Shannon entropy rate.
متن کاملPoisson Representations of Branching Markov and Measure-valued Branching Processes By
Representations of branching Markov processes and their measurevalued limits in terms of countable systems of particles are constructed for models with spatially varying birth and death rates. Each particle has a location and a “level,” but unlike earlier constructions, the levels change with time. In fact, death of a particle occurs only when the level of the particle crosses a specified level...
متن کاملOn the Poisson Equation for Markov Chains : Existence of Solutions and Parameter Dependenceby Probabilistic
This paper considers the Poisson equation associated with time-homogeneous Markov chains on a countable state space. The discussion emphasizes probabilistic arguments and focuses on three separate issues, namely (i) the existence and uniqueness of solutions to the Poisson equation, (ii) growth estimates and bounds on these solutions and (iii) their parametric dependence. Answers to these questi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Queueing Syst.
دوره 46 شماره
صفحات -
تاریخ انتشار 2004